The maximum mutual information between the output of a discrete symmetric channel and several classes of Boolean functions of its input

نویسنده

  • Septimia Sarbu
چکیده

We prove the Courtade-Kumar conjecture, for several classes of n-dimensional Boolean functions, for all n ≥ 2 and for all values of the error probability of the binary symmetric channel, 0 ≤ p ≤ 1 2 . This conjecture states that the mutual information between any Boolean function of an n-dimensional vector of independent and identically distributed inputs to a memoryless binary symmetric channel and the corresponding vector of outputs is upper-bounded by 1 − H(p), where H(p) represents the binary entropy function. That is, let X = [X1 . . . Xn] be a vector of independent and identically distributed Bernoulli( 1 2 ) random variables, which are the input to a memoryless binary symmetric channel, with the error probability in the interval 0 ≤ p ≤ 1 2 , and Y = [Y1 . . . Yn] the corresponding output. Let f : {0, 1}n → {0, 1} be an n-dimensional Boolean function. Then, MI(f(X),Y) ≤ 1−H(p). Our proof employs Karamata’s theorem, concepts from probability theory, transformations of random variables and vectors and algebraic manipulations. Index Terms Boolean function, mutual information, Karamata’s theorem, memoryless discrete symmetric channel, binary entropy function

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On the Courtade-Kumar conjecture for certain classes of Boolean functions

We prove the Courtade-Kumar conjecture, for certain classes of n-dimensional Boolean functions, ∀n ≥ 2 and for all values of the error probability of the binary symmetric channel, ∀0 ≤ p ≤ 1 2 . Let X = [X1 . . . Xn] be a vector of independent and identically distributed Bernoulli( 1 2 ) random variables, which are the input to a memoryless binary symmetric channel, with the error probability i...

متن کامل

The maximum mutual information between the output of a binary symmetric channel and a Boolean function of its input

We prove the Courtade-Kumar conjecture, which states that the mutual information between any Boolean function of an n-dimensional vector of independent and identically distributed inputs to a memoryless binary symmetric channel and the corresponding vector of outputs is upper-bounded by 1 − H(p), where H(p) represents the binary entropy function. That is, let X = [X1 . . . Xn] be a vector of in...

متن کامل

An Information-Theoretic Discussion of Convolutional Bottleneck Features for Robust Speech Recognition

Convolutional Neural Networks (CNNs) have been shown their performance in speech recognition systems for extracting features, and also acoustic modeling. In addition, CNNs have been used for robust speech recognition and competitive results have been reported. Convolutive Bottleneck Network (CBN) is a kind of CNNs which has a bottleneck layer among its fully connected layers. The bottleneck fea...

متن کامل

ON THE FUZZY SET THEORY AND AGGREGATION FUNCTIONS: HISTORY AND SOME RECENT ADVANCES

Several fuzzy connectives, including those proposed by Lotfi Zadeh, can be seen as linear extensions of the Boolean connectives from the scale ${0,1}$ into the scale $[0,1]$. We discuss these extensions, in particular, we focus on the dualities arising from the Boolean dualities. These dualities allow to transfer the results from some particular class of extended Boolean functions, e.g., from c...

متن کامل

Carnot in the Information Age: Discrete Symmetric Channels

Modeling communication channels as thermal systems results in Hamiltonians which are an explicit function of the temperature. The first two authors have recently generalized the second thermodynamic law to encompass systems with temperature-dependent energy levels, dQ = TdS+ < dE/dT > dT , where < · > denotes averaging over the Boltzmann distribution, recomputing the mutual information and othe...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1701.05014  شماره 

صفحات  -

تاریخ انتشار 2017